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AN INEQUALITY FOR THE DISTANCE BETWEEN DENSITIES OF FREE 

CONVOLUTIONS 

V. KARGIN 



,-H Abstract 

(^ It is shown that under some conditions the distance between densities of free 

C^l convolutions of two pairs of probability measures is smaller than the maxi- 

^ mum of the Levy distance between the corresponding measures in these pairs. 

In particular, weak convergence fin ^ iJ,, Ua ^ v implies that the density of 
lj,n ffl Un is defined for all sufficiently large n and converges to the density of 
'~^ /U ffl z^. Some applications are provided including (i) a new proof of the local 

Pi version of the free central limit theorem, (ii) a local limit theorem for sums of 

(-H free projections, and (iii) a local limit theorem for sums of ffl-stable random 

^ variables. In addition, a local limit law for eigenvalues of a sum of N-hy-N 

Q random matrices is proved. 

,-H 1. Introduction 

> 

C"^^ This paper contributes to the study of free convolution of probability measures by showing 

^ that under some conditions, if measures fii and Ui, i = 1,2, are close to each other in terms of 

O the Levy metric and if free convolution /ii ffl fi2 is absolutely continuous, then vi ffl z^2 is also 

^ absolutely continuous and the densities of measures z^i ffl U2 and ^i ffl ^2 are close to each 

j—{ other. 

^ The study of the free convolution is motivated by numerous applications of this operation. 

. ^ It first arose in the study of operator algebras (|20J). If two self- adjoint operators A and B with 

/\ spectral measures jja and fxs are free, then their sum A+B has the spectral measure /ia^I^b, 

C^ where ffl denotes the free convolution operation. A concrete example of free operators is given 

by P (gi) and Q (§2) , where gi and g2 are operators of left multiplication by generators gi 

and 52 in the group algebra G (Z * Z) , and P, Q are two self-adjoint polynomials. Here Z * Z 

denotes the free group with two generators gi and 52 ■ 

Surprisingly, free convolution also appears prominently in the theory of large random ma- 
trices ( 11211 . lITTll . |fT6) ). Roughly speaking, if A]\i and Bj\j are two independent sequences of 
Hermitian N-hy-N matrices with empirical distribution of eigenvalues fiA^ ^nd fis^ , and if 
/^Ajv ~^ f^a and fiBjsi — ?" M;3 as A^ — )• 00, then the empirical distribution of eigenvalues of 
A]\f + Bn converges to /Uq, ffl /i/3 . This link with random matrices brought some breakthrough 
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2 V. KARGIN 

results in the theory of operator algebras ((231, ifTOl ). and attracted the attention of physicists 
(EH. ill)- A recent illustration of the connection between free probability techniques and 
random matrices is a proof of the so-called single ring theorem for random matrices (Q). 

Another surprising application of free convolution is to the representation theory of the 
symmetric group Sn (Q). Recall that irreducible representations of S'„ are indexed by Young 
diagrams (i.e., partitions of n). Every Young diagram corresponds in a one-to-one fashion to a 
certain probability measure, the transition measure of the diagram. Biane discovered that for 
large-dimensional representations the measure of the outer product of irreducible representa- 
tions is close to the free convolution of the measures of original representations. 

These applications suggest that free convolution of probability measures deserves a de- 
tailed study. Such a study was initiated by Voiculescu in |[20l . It was noted that free con- 
volution has strong smoothing properties, and in particular, the free convolution of discrete 
measures is often absolutely continuous. More precisely, it was proved in ||4l that fii ffl //2 has 
an atom at X if and only if there are y and z such that x = y + z, and/ii ({y}) + //2 ({-2}) > 1- 
In fll, it was shown that fii ffl fi2 can have a singular component if and only if one of the 
measures is concentrated on one point and the other has a singular component (so that the re- 
sulting free convolution is simply a translation of the measure with the singular component). 
Moreover, in the same paper it was shown that the density of the absolutely continuous part is 
analytic wherever the density is positive and finite. 

In earUer work, some quantitative versions of this smoothing property of free convolution 
were given. In particular, in f2T\ it was shown that if ^ui is absolutely continuous with density 
vi G LP (M) , (j» G (1, 00]), then the free convolution /ii ffl ^2 is absolutely continuous with 
density v^ G L^ (M) , and llt^mH < ||i)i|| . In particular, the supremum of the density v^ is 
less than or equal to the supremum of the density of vi . 

Another important property of free convolution is that it is continuous with respect to 
weak convergence of measures. In particular, by a result in ||2l, if fij^ — >■ ^ and i/at — )■ 1/ as 
N — )• 00, then fij\f ffl z^at — )• /U ffl i^. In fact. Theorem 4. 13 in [2] says that di (/^ ffl i^, fJ-' ffl i^') < 
dL ifi, ij!)+dL {v, u') , where di denotes the Levy metric on probability measures on M, which 
metrizes weak convergence of measures. 

The main result of this paper establishes a strengthened version of this property. If dis- 
tances di {fj,, fi') and d^ {u, v') are sufficiently small and // ffl z/ is absolutely continuous, then 
fi' ffl u' is also absolutely continuous and the distance between the densities of /i ffl z^ and /z' ffl u' 
can be bounded in terms of the Levy distances between the original measures. 

In particular, this result shows that free convolution transforms the weak convergence of 
measures |Ujv — ^ /^ and z/jy — )• z^ into the convergence of probability densities of //jv ffl z/jy to 
the density oi fiSu. 

We prove this result under an additional assumption imposed on measures jj, and u, which 
we call the smoothness of the pair (/i, u) at a point of its support E. This assumption holds if 
fi = V and the density of /i ffl /i is absolutely continuous and positive at E. In the case when 
fi y^ V, this assumption should be checked directly. We envision that in applications fi and 
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V are fixed measures for which this assumption can be directly checked, and ^at and z/jv are 
(perhaps random) measures for which it can be checked that they are close to \x and v in Levy 
distance. 

In order to formulate our main result precisely, we introduce several definitions. Let [ia 
and \iB be two probability measures on M with the Stieltjes transforms vtla (-z) and m^ (z) , 
where the Stieltjes transform of a probability measure // is defined by the formula 

li{dx) 



m{z) := 

Then, the free convolution jj^a ffl fJ-B is defined as the probability measure with the Stieltjes 
transform, m^ (z), which satisfies the following system of equations: 

(1) 



mm [z) = 


= ruAiz - Sb (z)) , 


mm (z) = 


= mB{z- Sa {z)) , 


1 


= Sa(z) + Sb{z), 



z + 

mffl [z 

where Sa (z) and Sb (z) are auxiliary functions. 

This is not the standard definition of free convolution. Usually, one defines the i?-transform 
of measure fiA by the formula R (t) = m^ {—t) — l/t, where rUj^ is the functional inverse 
of m, and similarly for Ra (t) . Then R = Ra + Rb is the i?-transform of a probability 
measure, which is fiA ffl A^s- (Our references for free probability are ifTSll and lITSl ). It is easy 
to check that our definition is equivalent to the standard with the relation between functions 
Sa,b and /^-transforms given by 

Sa (z) = Ra {-mm (z)) , 

and similarly for Sb (z) and Rb (z) . 

It is an important and non-trivial fact that Sa,b {z) is analytic everywhere in C+ and maps 
C+ to C^, where C+ = {z : Iraz > 0} and C^ = {z : Iraz < 0} ([61). These functions are 
called subordination functions for the pair {fj,A, fJ-s) ■ 

We define tA{z) = z — Sa{z) and similarly for Ib- Then tA,Biz) are analytic everywhere 
in C+ and Imt^^.^ (z) > luiz. 

From the definition of Ia^b (z) , and the third equation in system ([T]l, it follows that 
mm (z) = (z — tA (z) — tB (z))^ , and the first and second equations of ([ijl imply a sys- 
tem of equations for tA and t^: 

mA {tB {z)) , (2) 



Z-tA (z) - tB (z) 

1 



rriB (tA (z)) . 



Z-tA (z) - tB (z) 

For large z, tA{z) ~ z + 0(1), and similarly for t_B(z). 

The analytic solutions of system (|2]) that satisfy this asymptotic condition at infinity are 
unique in C"*" = {zllmz > 0}. This follows from the facts that the solutions are unique in 
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the area liaz > i]q for sufficiently large 770 and that the analytic continuation in a simply- 
connected domain is unique. 

Definition 1.1. A pair of probability measures on the real line {^a-, I^b) i^ called smooth at 
E if the limits tA (E) = lim^4,o Im^A (E + iij) and ts (E) = lini,,j|o Inits {E + irj) exist and 
if both IratAiE) andlmtBiE) are positive. 

Definition 1.2. A point E & M. is called generic with respect to measures {iia^^p) if the 
following equation holds: 

Let /ii and ^2 be two probability measures on the real line, and let Fi (t) and F2 (t) be 
their cumulative distribution functions. The Levy distance between measures fii and /i2 is 
defined by the formula: 

dl (/^i,/"2) = supinf {s > : F2 (x - s) - s < Fi (x) < F2 (x + s) + s} . 

X 

The Levy distance is in fact a metric on the space of probability measures and the convergence 
with respect to this metric is equivalent to the weak convergence of measures. 
Here is the main result of this paper. 

Theorem 1.3. Assume that a pair of probability measures {fiA, IJ-b) is smooth at E and that E 
is generic for (pA , I^b)- Then, for some positive sq and c and all pairs of probability measures 
{yAi i^b) such that dL (fJ-A, ^a) < s < sq and di {fJ-B, ^b) < s < sq., it is true that va ffl ^s 
is absolutely continuous in a neighborhood of E with the density pm,u> cind 

\pm,u{E) - pm{E)\ < cs. 



This theorem will be proved as a corollary to Proposition 2.4 below. The assumptions of 
the theorem are sufficient but possibly not necessary. Of course, it is necessary to require 
that fiA ffl fJ-B be absolutely continuous in a neighborhood of E so that the density p^ [E] is 
defined. However, it is not clear if this assumption alone implies the statement of the theorem. 

The constant c in the theorem can be bounded in terms of Ia (E) , ts (E) and |A;(i?)| . 
In particular, if Ia (E) , ts (E) and |A:(i?)| are uniformly bounded away from zero for all 
E G (a, b) , then sup^jg^^ j,) \pa^,y {E) — p^ {E)\ < cs for some c > 0. 



The main ideas of the proof of Theorem 1.3 are as follows. Let 771^,1/ (2^) denote the Stieltjes 



transform of uaSub- (We also define Sa,u, Sb,u, tA,u, and ts^u for the pair {ua, vb) similarly 
to corresponding objects for the pair {pA, Pb), which were denoted Sa, Sb, tA, and t^.) 
First, we prove that the smallness of dL{pA, ^a) and diipB, ^b) implies that the differences 
\'mA,v — fnA\ and \mB,u — t^b\ are small, as well as the differences between derivatives of 
the Stieltjes transforms. Then we show that this fact, together with system Q, implies that the 
difference between corresponding t functions is small. At this stage we need the assumption 
of smoothness of the pair of measures as well as condition Q. Finally, we check that if both 
Stieltjes transforms and t-functions are close to each other, then the Stieltjes transforms of 
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fiA ffl fJ-B and UA ffl I'B are close to each other, which impUes that the densities of these free 
convolutions are close to each other. 

In the case when fiA = fJ-s = A*, the smoothness of the pair (/x, //) is easy to check by 
using the following proposition. 

Proposition 1.4. If fiS fi is (Lebesgue) absolutely continuous in a neighborhood of E and 
the density of fi ffl /x is positive at E, then (//, fi) is smooth at E. 

Note that even if the measures fiA and fiB are discrete, their free convolution can be 
Lebesgue absolutely continuous everywhere. For example, this is true for fiA = fJ-B = 
{6-1 + do + (5i)/3. Moreover, by results in [1], if measure jj^a ffl fJ-B is absolutely contin- 
uous in a neighborhood of xq and its density is positive at xq, then the density is analytic. 

The idea of the proof of this proposition is that if tA (z) = ts (z) := t (z) , then we can 
express it as t (z) = (1/2) (z — ma{z)~ j , and the smoothness of /zffl/i implies that mg (z) 
is bounded and has a limit when z approaches the real axis. Therefore, Imt (z) is bounded 
and positive as Imz I 0, and the pair (/i, fi) is smooth. The details will be given in Sectionls] 

Another important case is when one of the probability measures is semicircle. The semi- 
circle distribution A is an absolutely continuous distribution supported on the interval [—2, 2] 
and its density is 

A(x) = -- \/4 - x^ 
27r 

on this interval. 

Since A is absolutely continuous, A ffl ^ is always absolutely continuous. 

Proposition 1.5. Let fiA = /^be the semicircle distribution. If the density ofXSfis is positive 
at E, and |mH iE)\ ^ 1, then (A, /i^) is smooth at E. 



Theorem |1.3| can be applied to derive some new results about sums of free random variables 
and about eigenvalues of large random matrices. 

li Xi, . . . ,Xn are free, identically distributed self-adjoint random variables with finite 
variance a'^, then it is known ( |[T9l . l[T4l ) that Sn := {Xi + . . . + Xn) / {(Ty/n) converges in 
distribution to a r.v. X with the standard semicircle law. Bercovici and Voiculescu in ||3l 
showed that the convergence in this limit law holds in a stronger sense. Namely, assuming 
that Xi are bounded, they showed that Sn has a density for all sufficiently large n and that the 
sequence of these densities converges uniformly to the density of the semicircle law. Recently, 
this result was generalized in ll24i to the case of possibly unbounded Xi with finite variance. 
This result can be considered as a local limit version of the free CLT. 



In the first application (Theorem 4. 1 ), we give a short proof of this result by using Theorem 



In the second application (Theorem 4.2 1, we prove an analogous local limit result for the 
sums Sn = Xi^n + . • • + Xn^n, whcrc Xj „ are free projection operators with parameters 
Pi^n such that Ylll=iPi,n -^ X and maxjpj„ — )• as n — )• oo. The classical analogue of this 
situation is the sum of independent indicator random variables, and the classical result states 
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that the sums converge in distribution to the Poisson r.v. with parameter A. A local version of 
this result is absent in the classical case because the Poisson r.v. is discrete. In the free case, 
the limit is a r.v. with the Marchenko-Pastur law, which is continuous with bounded density 
for A > 1. We show that in this case the sum 5„ has a density for all sufficiently large n and 
the sequence of these densities converges uniformly to the density of the Marchenko-Pastur 
law. 



In the third application (Theorem 4.3 1, we show that a similar local limit result holds for 



sums of free ffl-stable random variables. 



The fourth application (Theorem 4.4 1 is of a different kind and is concerned with eigenval- 
ues of large random matrices. Let H^ = A]\j + UnB^U^, where ^at and B^ are A^-by-A'^ 
Hermitian matrices, and Un is a random unitary matrix with the Haar distribution on the uni- 
tary group U (N) . Let Aj^ > . . . > A]^ be the eigenvalues of Ajy. Similarly, let A^ and 
A^ be ordered eigenvalues of matrices Bn and H^, respectively. Define the spectral point 
measures of Aj^i by ham '■= A^ ^ ^k=i ^\(^')(u\^ ^^'^ define the spectral point measures of 
Bn and Hn similarly. 

Assume that fiA^ — ^ /^q and fiBjs, -^ fJ-fS- and that the support of fiA^ and fis^ is unifomly 
bounded. Let the pair {fia, /^/s) be smooth at E, and E be generic for (/Xq, fijs). 

Define TV/ := N^Hj^ (I), the number of eigenvalues of if at in interval/, and let TV^ {E) := 
M(^E-r],E+ri\ ■ Finally, assume that r] = rj (N) and , ^ ^ vi^) ^ 1- 



Then, by using the author's previous results from |[T3l . and Theorem 1.3 it is shown that 

with probability 1, where pg denotes the density of fia^ fJ-fS- This result can be interpreted as 
a local limit law for eigenvalues of a sum of random Hermitian matrices. 

The rest of the paper is organized as follows. Section |2] is concerned with the proof of 
the main theorem. Section [3] contains proofs of Propositions 1 1 .4| and 1.5 Section |4] contains 
applications, and Section[5]concludes. 

2. Proof of Theorem I1.3I 

Let Fi (x) and F2 (x) denote the cumulative distribution functions of measures /ii and fi2, 
respectively. 

Lemma 2.1. Let d^ (/^i, /i2) = s. Assume that h (x) is a C^ real-valued function, such that 
J_ \h(u)\ < 00 and J _ \h' {u)\ < 00. Assume that h{u) has a finite number of zeroes. 
Then, 



A 



h (n) F2 (rju) du — h (u) Fi (rju) du < as max { 1, ry } , 



where c > depends only on h. 

Proof: Let A be the set where h > and B the set where h < 0. These sets are unions of 
open intevals because his a. differentiable function. The boundary of these sets consists of the 
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points where /i = 0. By the definition of the Levy distance, 

A < h (u) [Fi {r]u + s) + s - Fi {■r]u)]du 

J A 

+ I h{u) [F2 {r]u) - F2 {rju + s) - s]du. 
Jb 

The estimation of these two integrals is similar. Consider, for example, the first one. 

First of all, note that 

/ h (n) sdu < cs 
J A 

because /^ \h{u)\ < 00. 

Next, let ^ = ^ + s/t]. Then, 



h (u) Fi {rju + s)du= lh{t- s/r]) Fi (r/i) dt, 
A J A 

and therefore, 

h (n) [Fi {r]u + s) - Fi {r]u)] du < I __[^{t- s/r]) - h (t)] Fi {j]t) dt 

JAnA 

^max i\h{t- s/7])\ , \h (t)|) Fi (rjt) dt. 
AAA 

For the first integral in this estimate, we can use the fact that 

h(t-s/v)-hit) = - f h'iOdt 



and therefore. 



__[h{t- s/r]) - h (t)] Fi {r]t) dt 
Ar\A 



< I I \h'{i)\Fi{r^t)didt 

Jm. Jt-s/ri 

r ( K+s/v \ 

= jJ^'iOl ij Fiir]t)dt\d^ 

< - f \h'{0\d^- 

V Jr 



__ma.x {\h {t - s/r])\,\h{t)\)Fi{r]t)dt < sup\h{t)\ 
AAA 



For the second integral, we note that 

AAA 

< sup\h{t)\ Ks/r], 

where K is the number of points in the border of A, that is, the number of zeroes of h (t) . 
By using all these estimates, we obtain: 

A < cs max { 1 , f/^ } , 

where c depends only on function h{t) .U. 

Now, let mi (z) and 77x2 (z) denote the Stieltjes transforms of measures /ii and /i2, respec- 
tively. 
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Lemma 2.2. Let di (/Ui, /X2) = s and z = E + iij, where rj > O.Then, 

(a) I mi (z) — ?7i2 {z)\ < csr]~^ max {1,17^^} where c > is a numeric constant, and 

(b) 1 2^ (mi (z) — ?n,2 (^;))| < Cr-ST/"-'^"''" max {l, ri~^^ where c > are numeric constants. 

Proof: (a) By integration by parts, we can write, 

Fi(A) 



mi (z) 



Hence, 



Imm-i iz 



00 (A - zY 
2r]{X-E) 



,d\. 



r/^ 



{X-Ey + r,^ 

\-E 



X-E 



2 i^i (A) dX 

-^Fi (A) dX 



+ 1 



2 '■°° 



Similarly, 



Re?TT,i (z) 



/oo 
Fi (ii; + 7?n) - 
-00 ( 1 

Fi (F + r?n) 



udu 



{l + u^f 
(n2 - 1) du 



[l + u^f ■ 

By translating measures ^1 and /X2 by E, we can assume that F = in the formulas for 
Immi (z) and Rem-i (z) . Hence, the claim (i) follows from Lemma 2.1 Claim (ii) can be 
derived similarly by using the fact that 

d^ 1 _ 1 

dyX-iri~ (X-ir^Y+^- 

D 

Lemma 2.3. Assume that the pair {/J. a, I^b) i^ smooth at E. Suppose that [ua^ '^b) is another 
pair of probability measures such that diipA-, i^a) < s and diifJ-B, i^b) < s. Let z = E + irj. 
Then, 



1 



Z-tA (z) - tB (z) 



and 



mA,y {tB (z)) 



mB,u (tA (z)) 



< as. 



< as, 



Z-tA [z) - tB {z) 

where c is a positive constant that depends only on the pair of measures p,A and p.B ■ 

That is, if we substitute tA and tB in the system for tA.v and tB^v, then the error is small. 
Proof: tA and tB satisfy the equations of system ([2]), which implies that it is enough to 
show that 

\mA,v {tB {z)) - ruA {tB {z))\ < cs 
and 

\mB,u {tA {z)) - TUB {tA {z))\ < cs 
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for all z = E -\- irj. This follows directly from Lemma [X2] and the assumption that the pair 
{fiA, fJ-s) is smooth at E. Indeed, let ijo (E) > denote min{ImtA (E) , Imt^ (E)}. Then, 
by Lemma [2i2{ 

|"ZA,j/ {tB (z)) - niA (tB {z))\ < cs mill 



,Vo{EyriUE)r 
and a similar estimate holds for the difference \mB,u (tA (z)) — itib (t^ iz))\- □ 

Proposition 2.4. Assume that a pair of probability measures {^a^I^b) is smooth at E and 
that E is generic for {fiA, I^-b) ■ Then for some positive sq and c and all pairs of probability 
measures {va^i^b) such that dL{pA,^A) < s < sq and diifJ-Bj'^B) < s < sq, the limits 
tA,v {E) := lim^j^o tA,v {E + iq) and tB,v (E) := lim^^o tB,u (E + ir]) exist, and it is true 
that 

\tA,u{E)-tA{E)\ <cs, 
and 

\tB,u(E)-tB{E)\ <cs. 



Corollary 2.5. Assume that assumptions of Proposition 2.4 hold. Then, ua ffl I'B is absolutely 
continuous in a neighborhood of E with the density pm,u, <^fid 

\pm,v{E) - pm{E)\ < cs. 

Proof of Corollary: Since m^^i, (z) = {z — tA,u (z) — tB,u {z))~ , hence Proposition 

|2.4| implies that the limit m^,;/ (E) = lim^^^o iT^m,u {E + irj) exists and 

\mm,u {E) - mm iE)\ < cs. 

Moreover, this is true for every x in a neighborhood of E with a uniform constant c. This 
implies that for all sufficiently small s, the measure ua ffl ub is absolutely continuous in a 
neighborhood of E with the density pm,u, and 

\pm,u {E) -pffl {E)\ < cs. 

D 



Proof of Proposition 2.4 : Let F (t) : C^ ^ C^ be defined by the formula: 




mB,u (h) 



( 2 'i\^^l'^ 

Let us usethenorm ||(a;i,X2)|| = I |xi| + |x2| ) .ByLemma 

cs for all z = E + if] and r; > 0. 

The derivative of F with respect to t is 



2.3 



\F{tA{z),tB{z))\\< 



pi ^l {z-ti- t2) ^ {z-ti-t2) "^ - m'^^^ (is) 

V {z-ti-t2)~^ -m's^iti) {z-h-t2)~^ 
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The determinant of this matrix is m,'^ ^ (^2) + fn'^ ^ (ti) {z — ti — ^2)^ """^a u (^2) "I's ,y (^i; 
By assumption of smoothness and by Lemma [Z2J this is close (i.e., < cs for some c > 0) 
to [m^ (is) + m'^ (ti)] {z-ti- t2)~^ - m^ (is) m'^ (ti) at (ti, is) = (^A (z) , tfi (^)) for 
all 2; in a neighborhood of E. The latter expression is non-zero by assumption Q. In addi- 
tion, the assumption of smoothness shows that {z — ti — t2)~ is bounded in a neighborhood 
of E. Hence, the entries of the matrix [-F'] are bounded at {Ia {z) , ts {z)) for all z in a 
neighborhood of E. This shows that operator norm of [F']~ is bounded. 

Similarly, the assumption of smoothness of (/x^, fJ-s) and Lemma [2^ imply that the oper- 
ator norm of F" is bounded for all (ti, t2) in a neighborhood of {tA {z) , ts (z)) and for all 
values of parameter z in a neighborhood of E. 

It follows by the Newton-Kantorovich theorem dHU) that the solution of the equation 
F{t) = 0, which is {tA,u{z), tB,u{z)), exists for all z = E + irj with rj > and satisfies the 
inequalities: 

\tA,u{z) -tA{z)\ < CS 

and 

\tB,u (z) -tB {z)\ < CS 

for all z with rj sufficiently close to 0. 

Since tA,v {z) and Ia {z) are analytic in C^ = {zjlmz > 0} and lim^^^o *A {E + irf) ex- 
ists, the fact that \tA,u {z) — tA {z)\ is bounded implies that tA,v (E) := lim^j^o ^A,i/ {E + irj) 
exists. A similar argument shows the existence of ts^u {E). Finally, by taking the limit we 
find that 

\tA,v{E)-tA{E)\ <cs 

and 

\tB,uiE)-tBiE)\ <cs. 

n 

3. Proof of Propositions I1.4I and I1.5I 

Recall that a function / (x) is called Holder continuous at xq if there exist positive con- 
stants a, C, and e such that |/(x) — / (xo)| < C\x — xo|" for all x such that \x — xq\ < e. 

Lemma 3.1. Suppose that a probability measure fi has a density which is positive and Holder 
continuous at E. Let m {z) be the Stieltjes transform of fi. Then \m{E + ir])\ < M < 00 for 
all f] > 0. 

Proof: The results of Sokhotskyi, Plemelj, and Privalov ensure that the limit of ?tt, (£' + ir]) 
exists when rj ^0 (see Theorems 14.1b and 14.1c in lOTl ). Since m{E + irj) is continuous in 
the upper half-plane and \'m{E + irj)\ < l/rj, the claim of the lemma follows. D 

Proof of Proposition [L4} Note that for the case ij,a = fJ-B = A*, 

t{z) = (z-msi{z)-')/2. (4) 
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Since ^ ffl /x is absolutely continuous in a neighborhood of E, and the density pg is positive 
at E, hence by results in HI p^ is analytic and therefore uniformly Holder continuous in a 
neighborhood of E. This implies that the limit ma (E) = lim,yj^o "^^ffl {E + i-q) exists and that 
Imma (E) = np^ (E) . Since pg (E) > by assumption, it is clear from ^ that the limit 
t (E) = lim^^o t{E + irj) exists. Moreover, since 

Imt (z) = - r? + — ^ 

^ V |mffl (z)| 



and by Lemma 3. 1 Remg {z) is bounded uniformly in rj, hence Imt (E) > 0. It follows that 
(/x, /u) is smooth at S. This completes the proof of the proposition. D 

Lemma 3.2. If ij,a has the semicircle distribution, then 

(i) tB = z-tA + ^; 
(ii) TTi-H = tA — z, and 
(Hi) tA satisfies the equation 

tA = Z+ '^^^"^^^ 



r: -tA 

Proof: (i) If fiA has the semicircle distribution, then m^ = — (z + z~^) ; hence the first 
equation in system (|2]) implies 



which simplifies to 
(ii) By using (i), 



tB = - \ : — + Z-tA-tB 

-lA-lB 



1 

tB = Z -tA-\ 



tA 



mm = 7 :r- = - (z - tA) ■ 

Z -tA-ts 



(iii) The second equation in system Q becomes 

PB {dx) 



D 

Proof of Proposition [L5| From (ii) in Lemma |3.2[ Imt^(£') = lm.mm{E) = irpmiE) > 
0. From (i), 

ImtB(^) = ImtA(^)(-l + 



\E-tA\' 
= lmtA{E)(-l + - ^ 

If \mm {E)f < 1 and Imt a (E) > 0, then Imi^ (E) > and (A, pb) is smooth. It is not 
possible that Img {E)\ > 1 and Imt^ (E) > because this would imply that luitB (E) < 
which is impossible by a general result of Biane. Hence, pm (E) > and \mm {E)\ ^ 1 
imply that (A, p-b) is smooth. D 
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4. Applications 

In the first application we re-prove the free local limit theorem which was first demon- 
strated in [3 1 for bounded random variables and later generalized in [i24il to the case of un- 
bounded variables with finite variance. 

Let Xi be a sequence of self-adjoint random variables in the sense of free probability the- 
ory. Define 5„ = {Xi + . . . + X„) /a/tI) and let //„ denote the spectral probabiUty measure 

ofSn- 

Theorem 4.1. Suppose Xi are freely independent, identically distributed with zero mean and 
unit variance. Let le = [—2 + e, 2 — e]. Then for all sufficiently large n, fin is (Lebesgue) 
absolutely continuous everywhere on I, and the density dfin/dx uniformly converges on /^ to 
the density of the standard semicircle law. 

Note that the results in imply that for every closed interval J outside of [2,-2] , the 
measure /i„ (J) = for all sufficiently large n, provided that ^i has bounded support. In 
addition, the uniform convergence on /^ can be strengthened to the uniform convergence on 
M as in the proof of Theorem 3.4(iii) in II241 . 

Proof: Let VA,n be the distribution of (Xi + . . . + X[„/2]) /\/^ arid VB,n be the distribu- 
tion of (^[n/2]+i + • • • + Xn) I \fn. By using the free CLT from [il4i (which generalizes the 
result in 1 19J), we infer that VA,n and VB,n converge weakly to fiA = fJ-B = fJ-, where // is the 
semicircle law with variance 1/2. It is easy to calculate 

tA = tB = , , 



and therefore the pair (^, /i) is smooth on I^. This also follows from Proposition 1.4 A 
calculation shows that condition Q is satisfied for each E £ I;,, and therefore the density of 
iJA,n ffl i^B,n cxists for all sufficiently large n, and converges to the density of /i ffl /z at each 



E G Is. A remark after Theorem 1.3 shows that the convergence is in fact uniform. Since 
UA^n ffl i^B,n = fJ-n, this implies that the density of /i„ converges uniformly on /g to the density 
of the standard semicircle law. D 

In a similar fashion, it is possible to prove the local limit law for the convergence to the 
free Poisson distribution. 

Let {^n,j}j'Li be freely independent self-adjoint random variables with the distribution 
Ain,i = Pn,iSi + (1 - Pn,i) Sq. Let Sn = Xn,i + • . . + Xn,n and let fin denote the spectral 
probability measure of 5„. Recall that the Marchenko-Pastur law with parameter A > 1 is the 
probability measure with the density 



p{x) 



4x- (1- A + x)^ 



on the interval [xmin, a^max] := 

this distribution is called the free Poisson distribution. 



27rx 

In the free probability literature, 



2 / ^\2 

A) ,(l + ^/A 
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Theorem 4.2. Assume that Yli=iPn,i — )• A > 1 and niaxjp„^j — )• a^ n — )• oo. Let I^ = 
[a^min + £; 2;max — c]- Then far all sufficiently large n, fj,n is (Lebesgue) absolutely continuous 
everywhere on Is, and the density d^n/dx uniformly converges on I^ to the density of the 
Marchenko-Pastur law with parameter A. 

The proof of this theorem is similar to the proof of the previous one. The first step is the 
proof of the weak convergence of /i„. In the case when pn^i = \/n for all i, it can be found 
on page 34 in lITSl . The general case is a minor adaptation of this case and we omit it. Next, 
we choose kn so that 

^Vn,i < A/2 < ^ pn,i 

i=l i=l 

and define VA,n and VB,n as the spectral probability measures of X„ i + . . . + X„,fc„ and 
Xn,kn+i + • • • + Xn^m respectively. It is easy to see that both VA,n and VB,n converge weakly 
to iiA = fJ'B = /^> the Marchenko-Pastur distribution with parameter A/2. By using Proposi- 
tion 



1.4 we conclude that the pair (/x, n) is smooth for every point in Jg. Moreover, a direct 
calculation shows that 

tA iz) = tB{z) = Uz + X-l + ^J (z - {I + X)f - 4\\ , 

and 

, , l-A/2 -z(l + A/2) + (l-A/2)^ 

mA = mB= ^ o + 



^^^ 2z2^(z-(l + A/2))2-2A 

After some calculations the violation of the genericity condition Q can be simplified to the 
following equation: 

f{E,X):=E'-(^5 + ^X^E^+(^7+^X + 2X^^E-{3-5X + ^X^ + ^\') = 0. (5) 

Figure [4] shows the contour plot of f{E, A). It can be seen from this plot and can be 
checked formally that for A > 1, there is only one E = E {X) that satisfies equation ^. 
Figure |4] shows the zero set of / {E, A) for A > 1, compai^ed with the bounds on the support 
of the Marchenko-Pastur distribution. It can be seen from this graph and can be checked 
formally that E{X) < tmin (A) = ( 1 — \/A) • Consequently, E is always generic for (/x, /i) 
and Theorem 1 1 . 3 1 applies . Hence, the density of /x„ converges uniformly on I^ to the density 
of the Marchenko-Pastur distribution with parameter A. □. 

Similar results can be established for other limit theorems except that it is more difficult 
to check the genericity of a point in the support of the Umit distribution. Here is one more 
theorem of this type. Let measures /x and v be called equivalent (fi ~ v) if there exist such 
real a and b, with a > 0, that for every Borel set 5 C M, fJ-iS) = v{aS + b). Recall that 
measure /i is called ffl-stable, if /i ffl /i ~ /i. Measure v belongs to the domain of attraction of 
a ffl-stable law ^, if there exist measures Vn equivalent to v such that 

I^„ ffl l/„ ffl . . . ffl l^n -^ A*. 
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Figure 1 . Contour plot of the right-hand side of equation [5] 
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Figure 2. The zero set of the right-hand side of Equation |5] compared with 
the support bounds for E 
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Clearly, in this case there exists a sequence of real constants Bn > and An such that if Xn 
are freely independent, identically distributed self-adjoint random variables with distribution 
u, then 

""^^-^^^-An^X, (6) 

where X is a random variable with distribution jj.. (More about the ffl-stability of probabiUty 
measures and its relation to the classical stability of probability measures can be found in ll5t). 
Let fin denote the measure of 

Xi + ...+Xn 



Bn 



Ar. 



Theorem 4.3. Suppose a '^-stable distribution fx is not equivalent to 5q. Let J be a bounded 
closed interval such that the density of fj, is strictly positive on J. Suppose that An, Bn, and 
fin are defined as in the limit law ([6]). Then fin is (Lebesgue) absolutely continuous on J for 
all sufficiently large n and there is a sequence of constants an and bn such that the density 
-4^ {E) univormly converges to the density -^ (E) at (Lebesgue) almost all E £ J. 

Proof: Let J C I, where the inclusion is strict and / is a larger bounded closed interval 
such that density of fi is strictly positive on I. It is possible to find such / because by the 
results of Biane in [5|, /i is absolutely continuous with analytical density. As the first step, we 
will show that fin is (Lebesgue) absolutely continuous on / for all sufficiently large n and that 
there is a sequence of constants a„ and 6„ such that the density -^^ (anE + bn) converges 



to the density ^ (E) at (Lebesgue) almost all E £ I. Note that by definition of //„, the 
convolution fin S fin = fJ.2n (a2n • +^2n) , whcrc a2n and b2n are certain constants. Since 



fiS fi = fi{a ■ +b) and fi has analytic density, therefore by Proposition 1.4 (/i, fi) is smooth 
at E £ (/ — b)/a. Almost all points E are generic for (fi, /x), since otherwise k (z) (in the 
genericity condition) would be exaclty which is not possible. Hence, by Theorem |1.3| the 
weak convergence /i„ — ;■ ^ implies that fi2n (a2n • +^2n) has a density on (/ — b)/a for large 
n and that the density uniformly converges to the density oi fi 'S fi = fj, [a ■ +6) . It follows 
that the density of fi2n (a2n • +&2n) uniformly converges to the density of fi on /, where 
a2n and b2n are some constants. The case of /X2n+i can be handled similarly by considering 

Since both fin [a-n ■ +bn] and fin converge to fi weakly [fin — )■ /x by assumption and 
fJ-n ( «„ • +bn ) — )■ /i by the convergence of densities), we can conclude that the Levy distance 
between fJ- [[■ — bn] /an ) and fi becomes arbitrary small as n — )■ oo. This implies that the 

sequences a„ and bn converge to 1 and 0, respectively. Otherwise, we could select a subse- 
quence of a„ and bn that converge to a limit (a, 6) ^ (1,0) and after taking the weak limit of 
measures fi ((■ — bn) /a-n ) we would find that fi{{- — b)/a) = fi, which is impossible. 

Let fn denote the density of fin and / the density of fi. By results of Biane in [5 1, density / 
is continuous at its support and approaches zero as |x| — )• oo, hence it is uniformly continuous. 
Moreover, for each e > 0, we can find 6 > such that if |a„ — 1| < 6 and bn < S, then 
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\f (x) — f {ttnX + bn)\ < e for all x. Hence, for every e > 0, we can find no > such that 



for all n > uq, 



fn ( anX + 6n ) ~ / ( ^-nX + 6n ) < £ for all X G /\5 where S* is a set of 
measure zero and a„ and 6„ are the sequences defined above. After a change of variables we 
find that |/„ (t) — f {t)\ < e for all t G ( I\S — bn ) /on- By using the fact that the union 
of sets of measure zero has measure zero, we can conclude that /„ (t) uniformly converges to 
/ (t) on J\S where J is an arbitrary closed subinterval of / and S" is a set of measure 0. D 

Our next application is of a different kind and answers a question that arises in the theory 
of large random matrices. 

Let Hn = Aj\f + UnBnUIj, where An and Bn are A^-by-A^ Hermitian matrices, and Un 
is a random unitary matrix with the Haar distribution on the unitary group U (N) . 

Let A^ > • . . > A]y be the eigenvalues of An- Similarly, let A^ and A^ be ordered 
eigenvalues of matrices Bn and Hn, respectively. 

Define the spectral point measures of An by ^Uyi^ := N^'^ ^k=i ^\(^'im^^ and define the 
spectral point measures of An and Hn similarly. Let A// := N^Hm {I) denote the number 
of eigenvalues of Hn in interval /, and let Mr/ [E] := J\f(^E-ri,E+ri] ■ 

Theorem 4.4. Assume that 

(1) fJ-AN -^ fJ-a and hbn -^ M/3- 

(2) suppifiApf) ^ supp{hbn) ^ [-K,K]forallN. 

(3) The pair {fia, fJ-is) is smooth at E, and E is generic for (//q,, fip). 

^'^ vim « ''(^^ « '■ 

Then, 
with probability 1, where pa denotes the density of ^a ffl A^^- 



Previously, it was shown by Pastur and Vasilchuk in 11161 that Assumption (1) together 
with a weaker version of Assumption (2) implies that hhj^ — )• /ia ffl /x^ with probability 1 . 



Theorem 4.4 says that convergence of p,Hj^ to p.a H A*/? holds on the level of densities, so it 
can be seen as a local limit law for eigenvalues of the sum of random Hermitian matrices. 

Proof: In Theorem 2 in [13], it was shown that the following claim holds. Suppose that 
T] = 7] (N) and l/^/[ogN <^ t] {N) <^ 1. Assume that measure ^An ^ ^-Bjv i^ absolutely 
continuous and its density is bounded by a constant Tn ■ Then, for all sufficiently large N, 



P <j sup 

E 






2Nr] 



>6}<eKp -c6'^^^], (7) 



(logAT)^ 



where c > depends only on Kn '■= max{||AAr|| , ||i?jv||} and Tn- Here q^^n denote the 
density of fiA^ ^ /^Siv (The notation / (N) ^ g{N) means that liniAr^^oo 9 (N) / f{N) = 

+00.) 



AN INEQUALITY FOR THE DISTANCE BETWEEN DENSITIES OF FREE CONVOLUTIONS 17 

This statement can be modified so that the supremum in the inequality holds for E in an 
interval, provided that the density of fXA^ ^ f^B^ i^ bounded by a constant T^ in this interval: 



sup 

Be(a,fe) 



^viE) „___,^, ^.l/_/ „.2 (riNf 



2N7] 



Qm,N (E) 



^*"M»n"'=*(Siw ■ ''' 



Since Assumptions (1) and (3) hold, therefore we can use Theorem 1.3 and infer that 
Qs^N (E) — )• Q^ [E) . In particular, the sequence of densities ^m^Af {E) is uniformly bounded 
by a constant T. This fact and Assumption (2) imply that the positive constant c in Q can be 
chosen independently of N. By using the Borel - Cantelli lemma, we can conclude that 

M^{E) 



2Nt] 
with probabiUty 1. D 



^eb(^) 



5. Conclusion 

We proved that if probability measures va and ub are sufficiently close to probabiUty 
measures fiA and fiB in the Levy distance, and if ^^ffl/^B is (Lebesgue) absolutely continuous 
at E, then (under some mild additional conditions), ua ffl i^b is also absolutely continuous at 
E and its density is close to the density of fiA ffl /^s- 

We applied this result to derive several local limit law results for sums of free random 
variables and for eigenvalues of a sum of random Hermitian matrices. 
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